SherbyNet - /page/wikibook/entry.mu

Micron Document

<!DOCTYPE html>

<title>FastText</title>

</head>

<span id="openzim-page-title" class="mw-page-title-main">fastText</span>

</h1>

</header>

/* start https://en.wikipedia.org/ */

.mw-parser-output .infobox-subbox{padding:0;border:none;margin:-3px;width:auto;min-width:100%;font-size:100%;clear:none;float:none;background-color:transparent}.mw-parser-output .infobox-3cols-child{margin:auto}.mw-parser-output .infobox .navbar{font-size:100%}@media screen{html.skin-theme-clientpref-night .mw-parser-output .infobox-full-data:not(.notheme)>div:not(.notheme)[style]{background:#1f1f23!important;color:#f8f9fa}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .infobox-full-data:not(.notheme)>div:not(.notheme)[style]{background:#1f1f23!important;color:#f8f9fa}}@media(min-width:640px){body.skin--responsive .mw-parser-output .infobox-table{display:table!important}body.skin--responsive .mw-parser-output .infobox-table>caption{display:table-caption!important}body.skin--responsive .mw-parser-output .infobox-table>tbody{display:table-row-group}body.skin--responsive .mw-parser-output .infobox-table th,body.skin--responsive .mw-parser-output .infobox-table td{padding-left:inherit;padding-right:inherit}}

/* end https://en.wikipedia.org/ */

</style><table class="infobox vevent"><tbody><tr><th colspan="2" class="infobox-above summary">fastText</th></tr><tr><td colspan="2" class="infobox-image logo"></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Programmer" title="Programmer">Developer(s)</a></th><td class="infobox-data"><a href="Facebook" title="Facebook">Facebook</a>'s AI Research (FAIR) lab<sup id="cite_ref-1" class="reference"><a href="#cite_note-1"><span class="cite-bracket">[</span>1<span class="cite-bracket">]</span></a></sup></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;">Initial release</th><td class="infobox-data">November 9, 2015<span style="display:none"> (<span class="bday dtstart published updated">2015-11-09</span>)</span></td></tr><tr style="display: none;"><td colspan="2" class="infobox-full-data"></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Software_release_life_cycle" title="Software release life cycle">Stable release</a></th><td class="infobox-data"><div style="margin:0px;">0.9.2<sup id="cite_ref-gith_face_v0.9.2_2-0" class="reference"><a href="#cite_note-gith_face_v0.9.2-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup>

/ April 28, 2020<span style="display:none"> (<span class="bday dtstart published updated">2020-04-28</span>)</span></div></td></tr><tr style="display:none"><td colspan="2">

</td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Repository_(version_control)" title="Repository (version control)">Repository</a></th><td class="infobox-data"><span class="url"><a rel="nofollow" class="external text" href="https://github.com/facebookresearch/fastText">github<wbr>.com<wbr>/facebookresearch<wbr>/fastText</a></span></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;">Written in</th><td class="infobox-data"><a href="C%2B%2B" title="C++">C++</a>, <a href="Python_(programming_language)" title="Python (programming language)">Python</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Computing_platform" title="Computing platform">Platform</a></th><td class="infobox-data"><a href="Linux" title="Linux">Linux</a>, <a href="MacOS" title="MacOS">macOS</a>, <a href="Windows" class="mw-redirect" title="Windows">Windows</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Software_categories#Categorization_approaches" title="Software categories">Type</a></th><td class="infobox-data"><a href="Machine_learning" title="Machine learning">Machine learning</a> <a href="Library_(computing)" title="Library (computing)">library</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;"><a href="Software_license" title="Software license">License</a></th><td class="infobox-data"><a href="MIT_License" title="MIT License">MIT License</a></td></tr><tr><th scope="row" class="infobox-label" style="white-space: nowrap;">Website</th><td class="infobox-data"><span class="url"><a rel="nofollow" class="external text" href="https://fasttext.cc/">fasttext<wbr>.cc</a></span></td></tr></tbody></table>

<p><b>fastText</b> is a library for learning of <a href="Word_embedding" title="Word embedding">word embeddings</a> and text classification created by <a href="Facebook" title="Facebook">Facebook</a>'s AI Research (FAIR) lab.<sup id="cite_ref-3" class="reference"><a href="#cite_note-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-4" class="reference"><a href="#cite_note-4"><span class="cite-bracket">[</span>4<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-5" class="reference"><a href="#cite_note-5"><span class="cite-bracket">[</span>5<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-6" class="reference"><a href="#cite_note-6"><span class="cite-bracket">[</span>6<span class="cite-bracket">]</span></a></sup> The model allows one to create an <a href="Unsupervised_learning" title="Unsupervised learning">unsupervised learning</a> or <a href="Supervised_learning" title="Supervised learning">supervised learning</a> algorithm for obtaining vector representations for words. Facebook makes available pretrained models for 294 languages.<sup id="cite_ref-7" class="reference"><a href="#cite_note-7"><span class="cite-bracket">[</span>7<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-8" class="reference"><a href="#cite_note-8"><span class="cite-bracket">[</span>8<span class="cite-bracket">]</span></a></sup> Several papers describe the techniques used by fastText.<sup id="cite_ref-9" class="reference"><a href="#cite_note-9"><span class="cite-bracket">[</span>9<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-10" class="reference"><a href="#cite_note-10"><span class="cite-bracket">[</span>10<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-11" class="reference"><a href="#cite_note-11"><span class="cite-bracket">[</span>11<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-12" class="reference"><a href="#cite_note-12"><span class="cite-bracket">[</span>12<span class="cite-bracket">]</span></a></sup> The GitHub repository has been archived on March 19, 2024.

</p>

<li><a href="GloVe" title="GloVe">GloVe</a></li>

<li><a href="Neural_network_(machine_learning)" title="Neural network (machine learning)">Neural network (machine learning)</a></li>

<li><a href="Natural_language_processing" title="Natural language processing">Natural language processing</a></li></ul>

<div class="mw-heading mw-heading2"><h2 id="References">References</h2></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}

/* end https://en.wikipedia.org/ */

</style><div class="reflist">

/* start https://en.wikipedia.org/ */

.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("./mw/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("./mw/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("./mw/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("./mw/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}

/* end https://en.wikipedia.org/ */

</style><cite id="CITEREFMannes" class="citation web cs1">Mannes, John. <a rel="nofollow" class="external text" href="https://techcrunch.com/2017/05/02/facebooks-fasttext-library-is-now-optimized-for-mobile/">"Facebook's fastText library is now optimized for mobile"</a>. <i><a href="TechCrunch" title="TechCrunch">TechCrunch</a></i><span class="reference-accessdate">. Retrieved <span class="nowrap">12 January</span> 2018</span>.</cite></span>

</li>

<li id="cite_note-gith_face_v0.9.2-2"><span class="mw-cite-backlink"><b><a href="#cite_ref-gith_face_v0.9.2_2-0">^</a></b></span> <span class="reference-text"><cite id="CITEREFOnur_Çelebi2020" class="citation web cs1">Onur Çelebi (2020-04-28). <a rel="nofollow" class="external text" href="https://github.com/facebookresearch/fastText/releases/tag/v0.9.2">"facebookresearch/fastText/releases/tag/v0.9.2"</a>. <i>Facebook</i><span class="reference-accessdate">. Retrieved <span class="nowrap">2020-11-21</span></span>.</cite></span>

</li>

<li id="cite_note-3"><span class="mw-cite-backlink"><b><a href="#cite_ref-3">^</a></b></span> <span class="reference-text"><cite id="CITEREFMannes" class="citation web cs1">Mannes, John. <a rel="nofollow" class="external text" href="https://techcrunch.com/2017/05/02/facebooks-fasttext-library-is-now-optimized-for-mobile/">"Facebook's fastText library is now optimized for mobile"</a>. <i><a href="TechCrunch" title="TechCrunch">TechCrunch</a></i><span class="reference-accessdate">. Retrieved <span class="nowrap">12 January</span> 2018</span>.</cite></span>

</li>

<li id="cite_note-4"><span class="mw-cite-backlink"><b><a href="#cite_ref-4">^</a></b></span> <span class="reference-text"><cite id="CITEREFRyan" class="citation web cs1">Ryan, Kevin J. <a rel="nofollow" class="external text" href="https://www.inc.com/kevin-j-ryan/facebook-open-source-fasttext-learns-1-billion-words-in-10-minutes.html">"Facebook's New Open Source Software Can Learn 1 Billion Words in 10 Minutes"</a>. <i><a href="Inc._(magazine)" title="Inc. (magazine)">Inc.</a></i><span class="reference-accessdate"> Retrieved <span class="nowrap">12 January</span> 2018</span>.</cite></span>

</li>

<li id="cite_note-5"><span class="mw-cite-backlink"><b><a href="#cite_ref-5">^</a></b></span> <span class="reference-text"><cite id="CITEREFLow" class="citation web cs1">Low, Cherlynn. <a rel="nofollow" class="external text" href="https://www.engadget.com/2016/08/18/facebook-open-sourcing-fasttext/">"Facebook is open-sourcing its AI bot-building research"</a>. <i><a href="Engadget" title="Engadget">Engadget</a></i><span class="reference-accessdate">. Retrieved <span class="nowrap">12 January</span> 2018</span>.</cite></span>

</li>

<li id="cite_note-6"><span class="mw-cite-backlink"><b><a href="#cite_ref-6">^</a></b></span> <span class="reference-text"><cite id="CITEREFMannes" class="citation web cs1">Mannes, John. <a rel="nofollow" class="external text" href="https://techcrunch.com/2016/08/18/facebooks-artificial-intelligence-research-lab-releases-open-source-fasttext-on-github/">"Facebook's Artificial Intelligence Research lab releases open source fastText on GitHub"</a>. <i><a href="TechCrunch" title="TechCrunch">TechCrunch</a></i><span class="reference-accessdate">. Retrieved <span class="nowrap">12 January</span> 2018</span>.</cite></span>

</li>

<li id="cite_note-7"><span class="mw-cite-backlink"><b><a href="#cite_ref-7">^</a></b></span> <span class="reference-text"><cite id="CITEREFSabin" class="citation web cs1">Sabin, Dyani. <a rel="nofollow" class="external text" href="https://www.inverse.com/article/31075-facebook-machine-learning-language-fasttext">"Facebook Makes A.I. Program Available in 294 Languages"</a>. <i><a href="Inverse_(website)" title="Inverse (website)">Inverse</a></i><span class="reference-accessdate">. Retrieved <span class="nowrap">12 January</span> 2018</span>.</cite></span>

</li>

<li id="cite_note-8"><span class="mw-cite-backlink"><b><a href="#cite_ref-8">^</a></b></span> <span class="reference-text"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://fasttext.cc/docs/en/pretrained-vectors.html">"Wiki word vectors"</a>. <i>fastText</i><span class="reference-accessdate">. Retrieved <span class="nowrap">26 November</span> 2020</span>.</cite></span>

</li>

<li id="cite_note-9"><span class="mw-cite-backlink"><b><a href="#cite_ref-9">^</a></b></span> <span class="reference-text"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="https://fasttext.cc/index.html">"References · fastText"</a>. <i>fasttext.cc</i><span class="reference-accessdate">. Retrieved <span class="nowrap">2021-09-08</span></span>.</cite></span>

</li>

<li id="cite_note-10"><span class="mw-cite-backlink"><b><a href="#cite_ref-10">^</a></b></span> <span class="reference-text"><cite id="CITEREFBojanowskiGraveJoulinMikolov2017" class="citation arxiv cs1">Bojanowski, Piotr; Grave, Edouard; Joulin, Armand; Mikolov, Tomas (2017-06-19). "Enriching Word Vectors with Subword Information". <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/1607.04606">1607.04606</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.CL">cs.CL</a>].</cite></span>

</li>

<li id="cite_note-11"><span class="mw-cite-backlink"><b><a href="#cite_ref-11">^</a></b></span> <span class="reference-text"><cite id="CITEREFJoulinGraveBojanowskiMikolov2016" class="citation arxiv cs1">Joulin, Armand; Grave, Edouard; Bojanowski, Piotr; Mikolov, Tomas (2016-08-09). "Bag of Tricks for Efficient Text Classification". <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/1607.01759">1607.01759</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.CL">cs.CL</a>].</cite></span>

</li>

<li id="cite_note-12"><span class="mw-cite-backlink"><b><a href="#cite_ref-12">^</a></b></span> <span class="reference-text"><cite id="CITEREFJoulinGraveBojanowskiDouze2016" class="citation arxiv cs1">Joulin, Armand; Grave, Edouard; Bojanowski, Piotr; Douze, Matthijs; Jégou, Hérve; Mikolov, Tomas (2016-12-12). "FastText.zip: Compressing text classification models". <a href="ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/1612.03651">1612.03651</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.CL">cs.CL</a>].</cite></span>

</li>

</ol></div></div>

<div class="mw-heading mw-heading2"><h2 id="External_links">External links</h2></div>

<ul><li><a rel="nofollow" class="external text" href="https://fasttext.cc">fastText</a></li>

<li><a rel="nofollow" class="external free" href="https://research.fb.com/downloads/fasttext/">https://research.fb.com/downloads/fasttext/</a></li></ul>

/* start https://en.wikipedia.org/ */

.mw-parser-output .hlist dl,.mw-parser-output .hlist ol,.mw-parser-output .hlist ul{margin:0;padding:0}.mw-parser-output .hlist dd,.mw-parser-output .hlist dt,.mw-parser-output .hlist li{margin:0;display:inline}.mw-parser-output .hlist.inline,.mw-parser-output .hlist.inline dl,.mw-parser-output .hlist.inline ol,.mw-parser-output .hlist.inline ul,.mw-parser-output .hlist dl dl,.mw-parser-output .hlist dl ol,.mw-parser-output .hlist dl ul,.mw-parser-output .hlist ol dl,.mw-parser-output .hlist ol ol,.mw-parser-output .hlist ol ul,.mw-parser-output .hlist ul dl,.mw-parser-output .hlist ul ol,.mw-parser-output .hlist ul ul{display:inline}.mw-parser-output .hlist .mw-empty-li{display:none}.mw-parser-output .hlist dt::after{content:": "}.mw-parser-output .hlist dd::after,.mw-parser-output .hlist li::after{content:" · ";font-weight:bold}.mw-parser-output .hlist dd:last-child::after,.mw-parser-output .hlist dt:last-child::after,.mw-parser-output .hlist li:last-child::after{content:none}.mw-parser-output .hlist dd dd:first-child::before,.mw-parser-output .hlist dd dt:first-child::before,.mw-parser-output .hlist dd li:first-child::before,.mw-parser-output .hlist dt dd:first-child::before,.mw-parser-output .hlist dt dt:first-child::before,.mw-parser-output .hlist dt li:first-child::before,.mw-parser-output .hlist li dd:first-child::before,.mw-parser-output .hlist li dt:first-child::before,.mw-parser-output .hlist li li:first-child::before{content:" (";font-weight:normal}.mw-parser-output .hlist dd dd:last-child::after,.mw-parser-output .hlist dd dt:last-child::after,.mw-parser-output .hlist dd li:last-child::after,.mw-parser-output .hlist dt dd:last-child::after,.mw-parser-output .hlist dt dt:last-child::after,.mw-parser-output .hlist dt li:last-child::after,.mw-parser-output .hlist li dd:last-child::after,.mw-parser-output .hlist li dt:last-child::after,.mw-parser-output .hlist li li:last-child::after{content:")";font-weight:normal}.mw-parser-output .hlist ol{counter-reset:listitem}.mw-parser-output .hlist ol>li{counter-increment:listitem}.mw-parser-output .hlist ol>li::before{content:" "counter(listitem)"\a0 "}.mw-parser-output .hlist dd ol>li:first-child::before,.mw-parser-output .hlist dt ol>li:first-child::before,.mw-parser-output .hlist li ol>li:first-child::before{content:" ("counter(listitem)"\a0 "}

/* end https://en.wikipedia.org/ */

</style><style data-mw-deduplicate="TemplateStyles:r1236075235">

/* start https://en.wikipedia.org/ */

.mw-parser-output .navbox{box-sizing:border-box;border:1px solid #a2a9b1;width:100%;clear:both;font-size:88%;text-align:center;padding:1px;margin:1em auto 0}.mw-parser-output .navbox .navbox{margin-top:0}.mw-parser-output .navbox+.navbox,.mw-parser-output .navbox+.navbox-styles+.navbox{margin-top:-1px}.mw-parser-output .navbox-inner,.mw-parser-output .navbox-subgroup{width:100%}.mw-parser-output .navbox-group,.mw-parser-output .navbox-title,.mw-parser-output .navbox-abovebelow{padding:0.25em 1em;line-height:1.5em;text-align:center}.mw-parser-output .navbox-group{white-space:nowrap;text-align:right}.mw-parser-output .navbox,.mw-parser-output .navbox-subgroup{background-color:#fdfdfd}.mw-parser-output .navbox-list{line-height:1.5em;border-color:#fdfdfd}.mw-parser-output .navbox-list-with-group{text-align:left;border-left-width:2px;border-left-style:solid}.mw-parser-output tr+tr>.navbox-abovebelow,.mw-parser-output tr+tr>.navbox-group,.mw-parser-output tr+tr>.navbox-image,.mw-parser-output tr+tr>.navbox-list{border-top:2px solid #fdfdfd}.mw-parser-output .navbox-title{background-color:#ccf}.mw-parser-output .navbox-abovebelow,.mw-parser-output .navbox-group,.mw-parser-output .navbox-subgroup .navbox-title{background-color:#ddf}.mw-parser-output .navbox-subgroup .navbox-group,.mw-parser-output .navbox-subgroup .navbox-abovebelow{background-color:#e6e6ff}.mw-parser-output .navbox-even{background-color:#f7f7f7}.mw-parser-output .navbox-odd{background-color:transparent}.mw-parser-output .navbox .hlist td dl,.mw-parser-output .navbox .hlist td ol,.mw-parser-output .navbox .hlist td ul,.mw-parser-output .navbox td.hlist dl,.mw-parser-output .navbox td.hlist ol,.mw-parser-output .navbox td.hlist ul{padding:0.125em 0}.mw-parser-output .navbox .navbar{display:block;font-size:100%}.mw-parser-output .navbox-title .navbar{float:left;text-align:left;margin-right:0.5em}body.skin--responsive .mw-parser-output .navbox-image img{max-width:none!important}@media print{body.ns-0 .mw-parser-output .navbox{display:none!important}}

/* end https://en.wikipedia.org/ */

</style></div><div role="navigation" class="navbox" aria-labelledby="Natural_language_processing454" style="padding:3px"><table class="nowraplinks hlist mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><style data-mw-deduplicate="TemplateStyles:r1239400231">

/* start https://en.wikipedia.org/ */

.mw-parser-output .navbar{display:inline;font-size:88%;font-weight:normal}.mw-parser-output .navbar-collapse{float:left;text-align:left}.mw-parser-output .navbar-boxtext{word-spacing:0}.mw-parser-output .navbar ul{display:inline-block;white-space:nowrap;line-height:inherit}.mw-parser-output .navbar-brackets::before{margin-right:-0.125em;content:"[ "}.mw-parser-output .navbar-brackets::after{margin-left:-0.125em;content:" ]"}.mw-parser-output .navbar li{word-spacing:-0.125em}.mw-parser-output .navbar a>span,.mw-parser-output .navbar a>abbr{text-decoration:inherit}.mw-parser-output .navbar-mini abbr{font-variant:small-caps;border-bottom:none;text-decoration:none;cursor:inherit}.mw-parser-output .navbar-ct-full{font-size:114%;margin:0 7em}.mw-parser-output .navbar-ct-mini{font-size:114%;margin:0 4em}html.skin-theme-clientpref-night .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}@media(prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}}@media print{.mw-parser-output .navbar{display:none!important}}

/* end https://en.wikipedia.org/ */

</style><div id="Natural_language_processing454" style="font-size:114%;margin:0 4em"><a href="Natural_language_processing" title="Natural language processing">Natural language processing</a></div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">General terms</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="AI-complete" title="AI-complete">AI-complete</a></li>

<li><a href="Bag-of-words_model" title="Bag-of-words model">Bag-of-words</a></li>

<ul><li><a href="Bigram" title="Bigram">Bigram</a></li>

<li><a href="Trigram" title="Trigram">Trigram</a></li></ul></li>

<li><a href="Computational_linguistics" title="Computational linguistics">Computational linguistics</a></li>

<li><a href="Natural_language_understanding" title="Natural language understanding">Natural language understanding</a></li>

<li><a href="Stop_word" title="Stop word">Stop words</a></li>

<li><a href="Text_processing" title="Text processing">Text processing</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Text_mining" title="Text mining">Text analysis</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Argument_mining" title="Argument mining">Argument mining</a></li>

<li><a href="Collocation_extraction" title="Collocation extraction">Collocation extraction</a></li>

<li><a href="Concept_mining" title="Concept mining">Concept mining</a></li>

<li><a href="Coreference#Coreference_resolution" title="Coreference">Coreference resolution</a></li>

<li><a href="Deep_linguistic_processing" title="Deep linguistic processing">Deep linguistic processing</a></li>

<li><a href="Distant_reading" title="Distant reading">Distant reading</a></li>

<li><a href="Information_extraction" title="Information extraction">Information extraction</a></li>

<li><a href="Named-entity_recognition" title="Named-entity recognition">Named-entity recognition</a></li>

<li><a href="Ontology_learning" title="Ontology learning">Ontology learning</a></li>

<li><a href="Parsing" title="Parsing">Parsing</a>

<ul><li><a href="Semantic_parsing" title="Semantic parsing">Semantic parsing</a></li>

<li><a href="Syntactic_parsing_(computational_linguistics)" title="Syntactic parsing (computational linguistics)">Syntactic parsing</a></li></ul></li>

<li><a href="Part-of-speech_tagging" title="Part-of-speech tagging">Part-of-speech tagging</a></li>

<li><a href="Semantic_analysis_(machine_learning)" title="Semantic analysis (machine learning)">Semantic analysis</a></li>

<li><a href="Semantic_role_labeling" title="Semantic role labeling">Semantic role labeling</a></li>

<li><a href="Semantic_decomposition_(natural_language_processing)" title="Semantic decomposition (natural language processing)">Semantic decomposition</a></li>

<li><a href="Semantic_similarity" title="Semantic similarity">Semantic similarity</a></li>

<li><a href="Sentiment_analysis" title="Sentiment analysis">Sentiment analysis</a></li></ul>

<ul><li><a href="Terminology_extraction" title="Terminology extraction">Terminology extraction</a></li>

<li><a href="Text_mining" title="Text mining">Text mining</a></li>

<li><a href="Textual_entailment" title="Textual entailment">Textual entailment</a></li>

<li><a href="Truecasing" title="Truecasing">Truecasing</a></li>

<li><a href="Word-sense_disambiguation" title="Word-sense disambiguation">Word-sense disambiguation</a></li>

<li><a href="Word-sense_induction" title="Word-sense induction">Word-sense induction</a></li></ul>

</div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th id="Text_segmentation21" scope="row" class="navbox-group" style="width:1%"><a href="Text_segmentation" title="Text segmentation">Text segmentation</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Compound-term_processing" title="Compound-term processing">Compound-term processing</a></li>

<li><a href="Lemmatisation" class="mw-redirect" title="Lemmatisation">Lemmatisation</a></li>

<li><a href="Lexical_analysis" title="Lexical analysis">Lexical analysis</a></li>

<li><a href="Shallow_parsing" title="Shallow parsing">Text chunking</a></li>

<li><a href="Stemming" title="Stemming">Stemming</a></li>

<li><a href="Sentence_boundary_disambiguation" title="Sentence boundary disambiguation">Sentence segmentation</a></li>

<li><a href="Word#Word_boundaries" title="Word">Word segmentation</a></li></ul>

</div></td></tr></tbody></table><div>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Automatic_summarization" title="Automatic summarization">Automatic summarization</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Multi-document_summarization" title="Multi-document summarization">Multi-document summarization</a></li>

<li><a href="Sentence_extraction" title="Sentence extraction">Sentence extraction</a></li>

<li><a href="Text_simplification" title="Text simplification">Text simplification</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Machine_translation" title="Machine translation">Machine translation</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Computer-assisted_translation" title="Computer-assisted translation">Computer-assisted</a></li>

<li><a href="Example-based_machine_translation" title="Example-based machine translation">Example-based</a></li>

<li><a href="Rule-based_machine_translation" title="Rule-based machine translation">Rule-based</a></li>

<li><a href="Statistical_machine_translation" title="Statistical machine translation">Statistical</a></li>

<li><a href="Transfer-based_machine_translation" title="Transfer-based machine translation">Transfer-based</a></li>

<li><a href="Neural_machine_translation" title="Neural machine translation">Neural</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Distributional_semantics" title="Distributional semantics">Distributional semantics</a> models</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<li><a href="Document-term_matrix" title="Document-term matrix">Document-term matrix</a></li>

<li><a href="Explicit_semantic_analysis" title="Explicit semantic analysis">Explicit semantic analysis</a></li>

<li><a href="GloVe" title="GloVe">GloVe</a></li>

<li><a href="Language_model" title="Language model">Language model</a> (<a href="Large_language_model" title="Large language model">large</a>)</li>

<li><a href="Latent_semantic_analysis" title="Latent semantic analysis">Latent semantic analysis</a></li>

<li><a href="Word_embedding" title="Word embedding">Word embedding</a></li>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Language_resource" title="Language resource">Language resources</a>,<br>datasets and corpora</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%">Types and<br>standards</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Corpus_linguistics" title="Corpus linguistics">Corpus linguistics</a></li>

<li><a href="Lexical_resource" title="Lexical resource">Lexical resource</a></li>

<li><a href="Linguistic_Linked_Open_Data" title="Linguistic Linked Open Data">Linguistic Linked Open Data</a></li>

<li><a href="Machine-readable_dictionary" title="Machine-readable dictionary">Machine-readable dictionary</a></li>

<li><a href="Parallel_text" title="Parallel text">Parallel text</a></li>

<li><a href="PropBank" title="PropBank">PropBank</a></li>

<li><a href="Semantic_network" title="Semantic network">Semantic network</a></li>

<li><a href="Simple_Knowledge_Organization_System" title="Simple Knowledge Organization System">Simple Knowledge Organization System</a></li>

<li><a href="Speech_corpus" title="Speech corpus">Speech corpus</a></li>

<li><a href="Text_corpus" title="Text corpus">Text corpus</a></li>

<li><a href="Thesaurus_(information_retrieval)" title="Thesaurus (information retrieval)">Thesaurus (information retrieval)</a></li>

<li><a href="Treebank" title="Treebank">Treebank</a></li>

<li><a href="Universal_Dependencies" title="Universal Dependencies">Universal Dependencies</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Data</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="BabelNet" title="BabelNet">BabelNet</a></li>

<li><a href="Bank_of_English" title="Bank of English">Bank of English</a></li>

<li><a href="DBpedia" title="DBpedia">DBpedia</a></li>

<li><a href="FrameNet" title="FrameNet">FrameNet</a></li>

<li><a href="Google_Ngram_Viewer" class="mw-redirect" title="Google Ngram Viewer">Google Ngram Viewer</a></li>

<li><a href="WordNet" title="WordNet">WordNet</a></li>

<li><a href="Wikidata" title="Wikidata">Wikidata</a></li></ul>

</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Automatic_identification_and_data_capture" title="Automatic identification and data capture">Automatic identification<br>and data capture</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Speech_recognition" title="Speech recognition">Speech recognition</a></li>

<li><a href="Speech_segmentation" title="Speech segmentation">Speech segmentation</a></li>

<li><a href="Speech_synthesis" title="Speech synthesis">Speech synthesis</a></li>

<li><a href="Natural_language_generation" title="Natural language generation">Natural language generation</a></li>

<li><a href="Optical_character_recognition" title="Optical character recognition">Optical character recognition</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Topic_model" title="Topic model">Topic model</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Document_classification" title="Document classification">Document classification</a></li>

<li><a href="Latent_Dirichlet_allocation" title="Latent Dirichlet allocation">Latent Dirichlet allocation</a></li>

<li><a href="Pachinko_allocation" title="Pachinko allocation">Pachinko allocation</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Computer-assisted_reviewing" title="Computer-assisted reviewing">Computer-assisted<br>reviewing</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Automated_essay_scoring" title="Automated essay scoring">Automated essay scoring</a></li>

<li><a href="Concordancer" title="Concordancer">Concordancer</a></li>

<li><a href="Grammar_checker" title="Grammar checker">Grammar checker</a></li>

<li><a href="Predictive_text" title="Predictive text">Predictive text</a></li>

<li><a href="Pronunciation_assessment" title="Pronunciation assessment">Pronunciation assessment</a></li>

<li><a href="Spell_checker" title="Spell checker">Spell checker</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="Natural-language_user_interface" title="Natural-language user interface">Natural language<br>user interface</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Chatbot" title="Chatbot">Chatbot</a></li>

<li><a href="Interactive_fiction" title="Interactive fiction">Interactive fiction</a></li>

<li><a href="Question_answering" title="Question answering">Question answering</a></li>

<li><a href="Virtual_assistant" title="Virtual assistant">Virtual assistant</a></li>

<li><a href="Voice_user_interface" title="Voice user interface">Voice user interface</a></li></ul>

</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Related</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">

<ul><li><a href="Formal_semantics_(natural_language)" title="Formal semantics (natural language)">Formal semantics</a></li>

<li><a href="Hallucination_(artificial_intelligence)" title="Hallucination (artificial intelligence)">Hallucination</a></li>

<li><a href="Natural_Language_Toolkit" title="Natural Language Toolkit">Natural Language Toolkit</a></li>

<li><a href="SpaCy" title="SpaCy">spaCy</a></li></ul>

</div></td></tr></tbody></table></div>

/* start https://en.wikipedia.org/ */

.mw-parser-output .asbox{position:relative;overflow:hidden}.mw-parser-output .asbox table{background:transparent}.mw-parser-output .asbox p{margin:0}.mw-parser-output .asbox p+p{margin-top:0.25em}.mw-parser-output .asbox-body{font-style:italic}.mw-parser-output .asbox-note{font-size:smaller}.mw-parser-output .asbox .navbar{position:absolute;top:-0.75em;right:1em;display:none}.mw-parser-output :not(p):not(.asbox)+style+.asbox,.mw-parser-output :not(p):not(.asbox)+link+.asbox{margin-top:3em}

/* end https://en.wikipedia.org/ */

</style>

</div><div><div class="zim-footer">

This article is issued from <a class="external text" title="Last edited on 2025-06-30" href="https://en.wikipedia.org/wiki/?title=FastText&oldid=1298061932">Wikipedia</a>. The text is available under <a class="external text" href="https://creativecommons.org/licenses/by-sa/4.0/deed.en">Creative Commons Attribution-Share Alike 4.0</a> unless otherwise noted. Additional terms may apply for the media files.

</div>

</div></div>

</div>

</main>

</div>

</body></html>